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Abstract 


The Connection Machine Model CM-2, a data parallel computer, integrates 64K bit-serial pro- 
cessors with 2K conventional floating point processors. This results in a system that can achieve 
high performance on applications involving many different data types, including flags, characters, 
integers, and floating point numbers. Bit-serial processors offer low circuit complexity, efficient 
use of memory space and bandwidth, and good performance for integer and logical operations. 
Conventional floating point processors offer high performance for complex mathematical opera- 
tions common in many applications. The CM-2 data processor efficiently integrates these two 
processor types with a novel device called a transposer. This paper will discuss processor design 
for a data parallel computer and describe the CM-2 data processor implementation. 


1 Introduction 


Traditionally, a common question to be answered in the design of a computer is the data word 
width of the processor. 1 As technology, languages, programming models and applications have 
changed over the last few decades, word widths of processors have varied widely. The EDSAC, 
for example, had a data word width of 35 bits [?]. The IBM 360 family of computers had word 
widths varying from 8 bits (the Model 30) to 64 bits (Models 60, 62, and 70)[?]. The data 
word width of the Burroughs’ B6500/B7500 computer systems were 51 bits [?]. Finally, standard 
microprocessors have adopted word widths of 8, 16, and now 32 bits, taking advantage of accepted 
formats for common data types. 


In this paper “data word width” is defined as the number of bits which are transferred to a processing element 
from primary memory. 
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Figure 1: The CM-2 Instruction Engine, Data Processors and Communications Network 


associated with a floating point processor, a local memory, and an interface chip which converts 
data between bit-serial words and 32-bit words. Each bit-serial processor can access 1 bit per 
memory access, while each floating point processor is capable of accessing 32 bits per memory 
access. Single precision floating point numbers can be transferred in one access while double 
precision numbers require 2 accesses each. 


The next two sections of this paper will examine processor design in a data parallel computer 
and present the CM-2 bit-serial and floating point processors. The following section will show a 
method for converting data from bit-serial words to 32-bit words, and will show how this integrates 
the two types of processors in the CM-2. The data parallel programming concepts of context and 
virtual processors will then be discussed, focusing on how these ideas are reflected in the CM-2 
processor design. Finally, the performance of the CM-2 will be examined for a variety of processor 
operations. 


as ease of design, relative size, and programming complexity. The second area is memory usage, 
which includes both storage efficiency and bandwidth usage. The final area is performance, which 
includes a wide range of cases depending on the data types to be used and the operations to be 
performed. The following sections will compare bit-serial and word-oriented processors for each 
of these areas. 


2.1 Implementation 


Bit-serial processors are very simple. A 3 input ALU that operates on single-bit quantities can 
only produce 8 possible outputs. Therefore, an ALU operation may be specified by providing 
the 8-bit truth table for the particular function. This means that bit-serial processors can be 
implemented with minimal instruction decoding. There are no carry chains since only one bit 
from each operand is available on each cycle. This simplicity makes them fast, compact, and easy 
to implement. Each CM-2 processor chip, for example, contains 16 bit-serial processors. Since 
they implement all possible boolean operations efficiently, bit-serial processors can support a wide 
variety of operations and data types. 

Word-oriented processors, on the other hand, are more special purpose. They are generally 
optimized for a fixed set of operations and data types. They use special logic to speed up 
operations whose outputs rely on the state of many input bits. Depending on their use, they may 
be general purpose enough to emulate the functions which are not part of their instruction set, or 
they may be so special purpose as to be only useful for the small set of instructions for which they 
were designed. For example, a Motorola 68020 processor is capable of emulating floating point 
instructions, while many commercial floating point chips are incapable of efficiently performing a 
logical OR operation. Directly performing special functions rather than emulating them with a 
series of logical operations make word-oriented ALUs, in general, more difficult to implement. 


-2.2 Memory Usage 


Bit-serial processors use memory very efficiently because any sized word can be stored without 
wasting any bits. Some word-oriented processors pack memory efficiently, but as the word size 
grows the likelihood of wasting memory often increases. Usually, word-oriented processors are 
tuned to common data types or storage formats and handle those cases very efficiently. If other 
storage formats or data types are desired, however, large penalties in either performance or storage 
efficiency result. 

These same cases usually result in a decrease in useful memory bandwidth for word-oriented 
machines. Bit-serial processors, on the other hand, only access the bits they need. In computers 


Flags (or booleans) are also efficiently manipulated with a bit-serial processor. Bit-serial 
processors only load and store the bits that are needed for a computation. Some word-oriented 
machines can store booleans efficiently by packing many into 1 word. Some of these processors 
also support loading and storing pieces of words, such as the PDP-10 with the LDB and DPB 
instructions. These processors typically waste memory bandwidth, though, by loading many bits 
that are not needed. 

Bit-serial processors do not perform very well on some operations where an output bit is 
computed from all input bits. For example, they are inefficient at integer multiplies since each 
output bit is potentially the result of an operation on all of the input bits. Since they have access to 
only 1 input bit at a time, bit-serial processors must resort to an iterative shift and add algorithm. 
Word-oriented processors, on the other hand, are able to take advantage of the presence of many 
of the input bits at once with additional logic specially designed for this operation. 

This problem with bit-serial processors is also evident in “normalizing”, or data dependent 
shifts. Again the problem arises because the value to be shifted by must be available all at once in 
order to make the operation efficient. This operation is common in floating point operations, and 
is accelerated in word-oriented processors by barrel shifters and special normalization circuits. 

Word-oriented and bit-serial processors are equal in speed for integer addition and logical 
operations (such as logical AND or XOR) if the data word lengths are appropriate for the word- 
oriented processor. Both are able to perform the calculation with only one memory access per 
operand. 


3 CM-2 Bit-Serial and Floating Point Processors 


As seen in Table 1, bit-serial and word-oriented processors each have strengths in areas where 
the other is weak. The CM-2 takes advantage of this relationship by using both general purpose 
bit-serial processors and word-oriented floating point processors. The bit-serial processor is used 
for logical operations, simple integer operations, and operations on boolean values, flags and 
tags. The floating point processor is responsible for floating point operations and complex integer 
operations such as multiplies. 

This section discusses the implementation of the bit-serial and the floating point processors 
of the CM-2. 
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Figure 4: The CM-2 Word-Oriented Floating Point Processor 


3.2 The CM-2 Word-Oriented processor 


The CM-2 has 2K floating-point processors each with 32 registers. These processors use data 
that has been converted to word-oriented format (see Section 4), and operate on them as 32- 
or 64-bit words depending on the processor (see Figure 4). The floating point processor is used 
for operations which are suited to word-oriented format and special purpose hardware. Such 
operations include integer multiply, floating point multiply, and floating point addition. 

The CM-2 is capable of handling 64-bit quantities with both the bit-serial and word-oriented 
processors. If the floating point processor can handle 64-bit numbers, then the 64-bit values are 
made available from memory in 2 32-bit quantities. This interleaving is necessary because the 
floating point processor has 32 bits for data input. The two halves are rejoined in the floating 
point processor and the operation is performed. The results are similarly stored to memory 
in two 32-bit halves. Due to the extra memory references, the performance of 64-bit math is 
approximately half that of 32-bit math. 
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Figure 5: A Transposer 
floating point processor. 


4.2 Transposer Chip 


The transposer chip in the CM-2 has separate 32-bit I/O busses for the bit-serial and word- 
oriented sides. The bit-serial side connects each of the 32-bits to a 64K by 1 bit array of memory 
and a single bit-serial processor. This bus is called the Memory Bus. The word-oriented side 
connects 32 bits to the 32-bit I/O port of a floating point processor. This is called the Float Bus. 
Each transposer chip also contains three transposers, each accessible from either bus. More than 
one transposer is necessary for support of context, virtual processors, and 64-bit floating point 
operations. These topics will be discussed in the following sections. 

Figure 2 shows how the processors and transposer chip are organized in the CM-2. Figure 6 
shows the architecture of the transposer chip. 


4.3 Example: Floating Point Multiply 


To describe the flow of data through the transposer chip, a compact notation will be used (see 
Table 2 for an example). A capital letter represents 64K 32-bit single-precision floating point 
numbers, one for each data processor. When stored in memory they are stored in bit-serial 
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M(A)* M(B) > M(C) 


Line Cycles Memory Bus Float Bus FPU 

1 32 M(A) > T0 

2 32 T0(A) > RegFile 

3 32 M(B) —T0 

4 32 T0(B) — ALU RegFile(A) * Input(B) + RegFile 
5 32 RegFile(C) — TO 

6 32 TO0(C) —- M 


Line 1: Operand A is loaded from memory into Transposer-0. 

Line 2: The transposed form of A is written from Transposer-0 to the register file of the floating 
point processor. 

Line 3: Operand B is loaded from memory into Transposer-0. 

Line 4: On each cycle one of the 32 instances of Operand B is written from Transposer0 to the 
ALU of the floating point processor. The other input of the ALU is supplied by the corresponding 
instance of Operand A from the register file. The result (C) is stored back into the register file 
in the same location as Operand A, which is smashed. 

Line 5: The result (C) is moved from the register file to Transposer-0. 

Line 6: The result (C), now transposed to bit-serial format, is written from Transposer0 into 
memory. 


Table 2: Floating Point Multiply 
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advantage of this characteristic in implementing context. Operations of the form A* B — C are 
fully supported, but require extra memory references to perform. 


5.1 Context in the CM-2 Bit-Serial Processor 


In the CM-2 bit-serial processor there is a fourth input to the ALU: a second flag is used for 
masking the effects of the processor. If this flag is on, then the computation proceeds, if it is 
off, then the processor does not change the destination. This flag is called the context-flag. The 
context-flag is readable and writable as a normal boolean field from the flags of the processor. 
Special operations always occur regardless of the value of the context-flag. This allows operations 
such as context-flag manipulation to have predictable results. 

If a given processor is not selected (its context-flag is off) then its state does not change until 
it is selected again. Contextualization is implemented on the bit-serial processors by doing every 
ALU operation in processors, but storing the original, unmodified value to processors which are 
not in the selected set. This is done by bypassing the ALU with the original value and inhibiting 
the writing of any in-processor flags for those processors. Through this mechanism, the entire 
state of a processor is preserved while it is unselected. 

For example, context may be used to multiply two 16-bit numbers with the bit-serial proces- 
sors. This operation is done by shifting one operand and conditionally adding it to the result 
depending on the appropriate bit of the other operand. That bit is actually used as the context- 
flag for the addition, prohibiting it in processors where it is zero. With this method a 16-bit 
multiply can be implemented as 16 conditional additions. | 


5.2 Context in the CM-2 Floating Point Processor 


Implementing contextualization in the word-oriented processors is more complicated. The trans- 
poser chip must retain the original data so that when the results are coming from the floating 
point processor the original data can be used instead of the result. Therefore only the contex- 
tualized processors’ data gets overwritten and the others are written with the original data. If 
there are enough transposers, then this operation can be done without affecting performance. If 
there are not enough transposers then the operation will take longer because the original data 
will have to loaded twice. 
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Line Cycles 


1 32 
2 32 
4 32 
5 32 
6 32 
7 32 
S «< 22 
9 32 
10 32 
11 32 
12 32 


Memory Bus 


M(A0) — T0 
M(B0)— T1 
M(A1)— TO 
M(B1)-T1 
T2(C0) — M 
M(A2) - T0 
M(B2) > T1 
T2(C1) —- M 
M(A3) > TO 
M(B3)-> T1 
T2(C2) ~ M 


M(A) * M(B) > M(C) 


Float Bus 


T0(A0) > RegFile 
T1(B0) — ALU 

RegFile(C0) + T2 
T0(Al1) — RegFile 
T1(B1) — ALU 

RegFile(C1) + T2 
T0(A2) — RegFile 
T1(B2) — ALU 

RegFile(C2) — T2 
T0(A3) — RegFile 


FPU 


RegFile( AO) * Input(B0) > RegFile 


RegFile(A1) * Input(B1) > RegFile 


Reg File(A2) * Input(B2) > RegFile 


Table 4: Floating Point Multiply, Pipelined for many Virtual Processors 


rate of 2600 Mflops would be achieved, which is the same as in Table 3. A single virtual processor, 
however, does not use the full memory bandwidth. This can be seen in Table 3 where the memory 
bus column is blank in lines 4 and 5. Similarly the float bus is unused in lines 1 and 6. This spare 


bandwidth can be used to begin the next virtual processor, overlapping their execution. 


This operation is shown in Table 4. In order to differentiate between virtual processors, an 
integer has been added to each operand (A, B or C) to signify its virtual processor number. The 
pipelined virtual processor implementation can achieve a computation rate of 4300 single precision 
Mflops for high numbers of virtual processors, 1700 Mflops higher than rate seen in Table 3. Note 
that a third transposer is being used here since a second virtual processor is being fetched as the 


first executes. 
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